View AP0100CS2L00SUGA0-DR1_8886724.PDF datasheet online --- IC-ON-LINE

Datasheet File OCR Text:

ap0100cs hdr: image signal processor (isp) features ? ap0100cs/d rev. 6, 1/16 en 1 ?semiconductor components industries, llc 2016, ap0100cs high-dynamic range (hdr) image signal processor (isp) ap0100cs datasheet, rev. 6 for the latest product datasheet, please visit www.onsemi.com features ? up to 1.2mp (1280x960) on semiconductor sensor support ? 45 fps at 1.2mp, 60 fps at 720p ? optimized for operation with hdr sensors. ? color and gamma correction ? auto exposure, auto white balance, 50/60 hz auto flicker detection and avoidance ? adaptive local tone mapping (altm) ? programmable spatial transform engine (ste). ? pre-rendered graphical overlay ? two-wire serial progra mming interface (ccis) ? interface to low-cost flash or eeprom through spi bus (to configure and load patches, etc.) ? high-level host command interface ? standalone operation supported ? up to 5 gpio ?fail-safe io ? multi-camera synchronization support ? integrated video encoder for ntsc/pal with overlay capability and 10-bit i-dac applications ? ip cam and cctv - hd ? enables cctv -hd w/ mp sensor notes: 1. table 1: key performance parameters parameter value primary camera interfaces parallel and hispi primary camera input raw12 linear/raw12, raw14 (hispi format only) companded output interface analog composite, up to 16-bit parallel digital output output format yuv422 8-bit,10-bit, and 10-, 12-bit tone-mapped bayer maximum resolution 1280x960 (1.2 mp) ntsc output 720h x 487v pal output 720h x 576v input clock range 6-30 mhz supply voltage v dd io_s 1.8 or 2.8 v nominal v dd io_h 2.5 or 3.3 v nominal v dd _reg 1.8 v nominal v dd 1.2 v nominal v dd _pll 1.2 v nominal v dd _dac 1.2v nominal v dd io_otpm 2.5 or 3.3 v nominal v dd a_dac 3.3 v nominal v dd _phy 2.8 v nominal operating temp. C30c to +70c power consumption 185 mw
ap0100cs/d rev. 6, 1/16 en 2 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) ordering information ordering information see the on semiconductor device nomenclature document (tnd310/d) for a full description of the naming convention used for image sensors. fo r reference documenta- tion, including information on evaluation kits, please visi t our web site at www.onsemi.com . table 2: available part numbers part number product description orderable product attribute description AP0100CS2L00SUGA0-DR1 1mp co-processor, 100-ball vfbga drypack ap0100cs2l00spgad3-gevk ap0100cs demo kit ap0100cs2l00spgah-gevb ap0100cs head board
ap0100cs/d rev. 6, pub. 1/16 en 3 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) table of contents table of contents features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 ordering information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 general description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4 functional overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4 system interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4 on-chip regulator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 multi-camera synchronization support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 image flow processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19 test patterns. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 camera control and auto functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 flicker avoidance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 flicker detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 output formatting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 bayer modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35 spatial transform engine (ste). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36 overlay capability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38 serial memory partition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40 overlay adjustment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 slave two-wire serial interface (ccis) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 protocol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 host command interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 start-up host command lock-out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52 multitasking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53 host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53 summary of host commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 usage modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57 two-wire serial register interf ace . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70 package diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
ap0100cs hdr: image signal processor (isp) general description ap0100cs/d rev. 6, pub. 1/16 en 4 ?semiconductor components industries, llc,2016. general description the on semiconductor ap0100cs is a high -performance, ultra-low power in-line, digital image processor optimized for use wi th hdr (high dynamic range) sensors. the ap0100cs provides full auto-functions support (awb and ae) and altm (adaptive local tone mapping) to enhance hdr images an d advanced noise reduction which enables excellent low-light performance. functional overview figure 1 shows the typical configuration of the ap0100cs in a camera system. on the host side, a two-wire serial interface is us ed to control the operation of the ap0100cs, and image data is transferred using the an alog or parallel interface between the ap0100cs and the host. the ap0100cs interface to the sensor also uses a parallel inter- face. figure 1: ap0100cs connectivity system interfaces figure 2: ?typical parallel configuration,? on page 5 and figure 3: ?typical hispi config- uration,? on page 6 show typica l ap0100cs devi ce connections. all power supply rails must be decoupled fr om ground using capacitors as close as possible to the package. the ap0100cs signals to the sensor and host in terfaces can be at different supply voltage levels to optimize power consumption and maximize flexibility. table 1 on page 9 provides the signal descriptions for the ap0100cs. 1.2mp hdr sensor 12-bit parallel host two-wire serial i/f (ccim) two-wire serial if (ccis) two-lane hispi or analog ntsc/pal display
ap0100cs/d rev. 6, pub. 1/16 en 5 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) system interfaces figure 2: typical pa rallel configuration notes: 1. this typical configuration shows only one scen ario out of multiple possi ble variations for this device. 2. on semiconductor recommends a 1.5k ?? resistor value for the two-wire serial interface r pull - up ; however, greater values may be us ed for slower transmission speed. 3. reset_bar has an internal pull-up resistor and can be left floating if not used. 4. the decoupling capacitors for the regulator input and output should have a value of 1.0uf. the capacitors should be ceramic and need to have x5r or x7r dielectric. 5. trst_bar connects to gnd for normal operation. 6. on semiconductor recommends that 0.1 ? f and 1 ? f decoupling capacitors for each power supply are mounted as close as possible to the pin. actual values an d numbers may vary depending on lay- out and design consideration v dd io_otpm ldo_op 4 v dd _reg 4 v dd io_s 6 v dd io _s v dd io _h sensor io power host io power m_s clk m_ s data extclk_out reset_bar_out fv_in lv_in pixclk_in din [11:0] trigger_out v dd _reg enldo fb_sense ldo_op v dd _pll 1.8v ( r egulator ip) v dd 1 . 2 v ( r egulator op) p ower up c ore, p ll. and dac digital gnd_reg fv_out lv_out pixclk_out d out [15:0] s clk s data s addr spi_cs_bar spi_clk spi_sdo spi_sdi trst_bar 5 v dd io_otpm otpm power v dd io_h gnd gpio_1 gpio_2 gpio_3 gpio_4 gpio_5 extclk xtal v dd io_dac dac_pos dac_neg dac_ref v dd _dac ext_reg dac analog power v dd a_dac v dd _phy frame_sync
ap0100cs hdr: image signal processor (isp) system interfaces ap0100cs/d rev. 6, pub. 1/16 en 6 ?semiconductor components industries, llc,2016. figure 3: typical hispi configuration hispi and parallel connection when using the hispi interface, the user should connect the parallel interface to v dd io_s. when using the parallel interface, the hispi interface and power supply (v dd _phy) can be left floating. v dd io_otpm ldo_op 4 v dd _reg 4 v dd io_s 6 v dd io _s v dd io _h sensor io power host io power m_s clk m_ s data extclk_out reset_bar_out fv_in lv_in pixclk_in din [11:0] trigger_out v dd _reg enldo 1.8v ( r egulator ip) gnd_reg fv_out lv_out pixclk_out d out [15:0] s clk s data s addr spi_cs_bar spi_clk spi_sdo spi_sdi trst_bar 5 v dd io_otpm otpm power v dd io_h gnd gpio_1 gpio_2 gpio_3 gpio_4 gpio_5 extclk xtal v dd io_dac dac_pos dac_neg dac_ref clk_n clk_p data0_n data0_p data1_n data1_p fb_sense ldo_op v dd _pll v dd 1 . 2 v ( r egulator op) p ower up c ore, p ll. and dac digital v dd _dac ext_reg dac analog power v dd a_dac v dd _phy hispi voltage v dd io_phy sensor io power frame_sync
ap0100cs/d rev. 6, pub. 1/16 en 7 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) system interfaces crystal usage as an alternative to using an external os cillator, a crystal may be connected between extclk and xtal. two small loading capacitors and a feedback resistor should be added, as shown in figure 4. figure 4: using a crystal inst ead of an external oscillator rf represents the feedback resistor, an rf value of 1m ? is sufficient for ap0100cs. c1 and c2 are decided according to the crystal or reso nator cl specification. in the steady state of oscillation, cl is defined as (c1 x c2)/(c1+c2). in fact, the i/o ports, the bond pad, package pin and pcb traces all contribute th e parasitic capacitance to c1 and c2. there- fore, cl can be rewritten to be (c1* x c2 *)/(c1*+c2*), where c1*=(c1+cin, stray) and c2*=(c2+cout, stray). the stray capacitance fo r the io ports, bond pad and package pin are known which means the formulas can be rewritten as c1*=(c1+1.5pf+cin, pcb) and c2*=(c2+1.3pf+cout, pcb). table 3: pin descriptions name type description extclk input master input clock. this can either be a square-wave generated from an oscillator (in which case the xtal input must be left unconnected) or direct connection to a crystal. xtal output if extclk is connected to one pin of a crystal, the other pin of the crystal is connected to xtal pin; otherwise th is signal must be left unconnected. reset_bar input/pu master reset signal, active low. this signal has an internal pull up. s clk input two-wire serial interface clock (host interface). s data i/o two-wire serial interfac e data (host interface). s addr input selects device address for the two-wire slave serial interface. when connected to gnd the device id is 0x90. when wired to v dd io_h, a device id of 0xba is selected. frame_sync input this signal is used to synchronize to external sources or multiple cameras together. this signal should be connected to gnd if not used. standby input standby mode control, active high. ext_reg input select external regulator if tied high extclk xtal ap0100cs c1 c2 rf=1m
ap0100cs hdr: image signal processor (isp) system interfaces ap0100cs/d rev. 6, pub. 1/16 en 8 ?semiconductor components industries, llc,2016. endlo input regulator enable (v dd _reg domain) spi_sclk output clock output for interfacing to an external spi flash or eeprom memory. spi_sdi input/pu data in from spi flash or eeprom memory. when no spi device is fitted, this signal is used to determine whether the ap0100cs should auto-configure: 0: do not auto-configure; two-wire inte rface will be used to configure the device (host-config mode) 1: auto-configure. this signal has an internal pull- up resistor. spi_sdo output data out to spi flash or eeprom memory. spi_cs_bar output chip select out to spi flash or eeprom memory. ext_clk_out output clock to external sensor. reset_bar_out output reset signal to external signal. m_s clk output two-wire serial interface clock (master). m_s data i/o two-wire serial interface clock (master). fv_in input sensor frame valid input. lv_in input sensor line valid input. pixclk_in input sensor pixel clock input. d in [11:0] input sensor pixel data input d in [11:0] clk_n input differential hispi clock (sub-lvds, negative). clk_p input differential hispi clock (sub-lvds, positive). data0_n input differential hispi data, lane 0 (sub-lvds, negative). data0_p input differential hispi data, lane 0 (sub-lvds, positive). data1_n input differential hispi data, lane 1 (sub-lvds, negative). data1_p input differential hispi data, lane 1 (sub-lvds, positive). trigger_out output trigger signal for external sensor. fv_out output host frame valid output (s ynchronous to pixclk_out) lv_out output host line valid output (syn chronous to pixclk_out) pixclk_out output host pixel clock output. d out [15:0] output host pixel data output (syn chronous to pixclk_out) d out [15:0]. dac_pos output positive video dac output in differenti al mode. video dac output in single- ended mode. this interface is enabled by default using ntsc/pal signaling. for applications where comp osite video output is no t required, the video dac can be placed in a power-down state under software control. dac_neg output negative video dac output in differential mode. dac_ref output external reference resistor for video dac. gpio [5:1] i/o general purpose digital i/o. trst_bar input must be tied to gnd in normal operation. v dd io_s supply sensor i/o power supply. v dd io_h supply host i/o power supply. v dd _pll supply pll supply. v dd supply core supply. v dd io_otpm supply otpm power supply. v dd _dac supply video dac digital power v dd a_dac supply video dac analog power v dd _phy supply phy io voltage for hispi table 3: pin descriptions (continued) name type description
ap0100cs/d rev. 6, pub. 1/16 en 9 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) system interfaces gnd supply ground v dd _reg supply input to on-chip 1.8v to 1.2v regulator. ldo_op output output from on chip 1.8v to 1.2v regulator. fb_sense output on-chip regulator sense signal. table 3: pin descriptions (continued) name type description
ap0100cs/d rev. 6, pub. 1/16 en 10 ?semiconductor components industries, llc,2016 part number: image signal processor (isp) system interfaces table 4: package pinout 1 2 3 4 5 6 7 8 9 10 a d out [11] d out [13] pixclk_out lv_out gpio_2 trst_bar spi_sdi s addr s clk standby b d out [12] d out [10] d out [14] fv_out gpio_3 gpio[5] spi_sclk s data trigger_out reset_bar_out c d out [9] d out [8] d out [15] gpio[1] gpio_4 spi_cs_bar spi_sdo v dd io_h m_s data m_s clk d d out [5] d out [6] d out [7] v dd io_h v dd io_host v dd frame_sync v dd fv_in m clk _out e d out [2] d out [3] d out [4] v dd io_h gnd gnd gnd lv_in pixclk_in d in [11] f d out [0] d out [1] extclk v dd io_h gnd gnd gnd v dd io_s d in [9] d in [10] g gnd v dd _pll xtal v dd v dd v dd gnd d in [6] d in [7] d in [8] h v dd _pll v dd _pll ldo_output v dd io_otpm dac_neg dac_ref gnda_dac v dd _phy d in [4] d in [5] j ext_reg reset_bar v dd _reg v dd _dac dac_pos data0_p clk_p data1_n d in [0] d in [2] k gnd fb_sense enldo gnd v dd a_dac data0_n clk_n data1_p d in [1] d in [3]
ap0100cs/d rev. 6, pub. 1/16 en 11 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) on-chip regulator on-chip regulator the ap0100cs has an on-chip regulator, the output from the regulator is 1.2 v and should only be used to power up the ap0100cs. it is possible to bypass the regulator and provide power to the relevant pins that need 1.2 v. figure 5 shows how to configure the ap0100cs to bypass the internal regulator. figure 5: exte rnal regulator the following table summarizes the key signals when using/bypassing the regulator. table 5: key signals when using the regulator signal name internal regulator external regulator v dd _reg 1.8 v connect to v dd io_h enldo connect to 1.8 v (v dd _reg) gnd fb_sense 1.2 v (output) float ldo_op 1.2 v (output) float ext_reg gnd connect to v dd io_h v dd io _s v dd io _h sensor io power host io power m_s clk m_ s data extclk_out reset_bar_out fv_in lv_in pixclk_in din [11:0] trigger_out v dd _reg gnd fv_out lv_out pixclk_out d out [15:0] s clk s data s addr spi_cs_bar spi_clk spi_sdo spi_sdi trst_bar v dd io_otpm otpm power gpio_1 gpio_2 gpio_3 gpio_4 gpio_5 extclk xtal dac_pos dac_neg dac_ref clk_n clk_p data0_n data0_p data1_n data1_p fb_sense ldo_op v dd _pll v dd external supplied 1.2v v dd _dac ext_reg dac analog power v dd a_dac v dd _phy phy power frame_sync standby host io power host io power enldo
ap0100cs hdr: image signal processor (isp) on-chip regulator ap0100cs/d rev. 6, pub. 1/16 en 12 ?semiconductor components industries, llc,2016. power-up sequence powering up the isp requires vo ltages to be applied in a pa rticular order, as seen in figure 6. the timing requirements are show n in table 6. the isp includes a power-on reset feature that initiates a re set upon power up of the isp. figure 6: power-up and power-down sequence note: 1. when using xtal the settling time should be taken into account. reset the ap0100cs has three types of reset available: ? a hard reset is issued by toggling the reset_bar signal ? a soft reset is issued by writing comman ds through the two-wire serial interface ? an internal power-on reset table 7 on page 13 shows the output states when the part is in various states. table 6: power-up and power-down signal timing symbol parameter min typ max unit t1 delay from v ddio _h to v dd io_s, v dd io_otpm, v dd a_dac, v dd _phy ( w hen using hispi) 0C50 ms t2 delay from v dd io_h to v dd _reg 0 C 50 ms t3 extclk activation t2 + 1 C C ms t4 first serial command 1 100 C C extclk cycles t5 extclk cutoff t6 C C ms t6 delay from v dd _reg to v dd io_h 0 C 50 ms t7 delay from v dd io_s, v dd io_otpm, v dd a_dac, v dd _phy ( w hen using hispi) to v dd io_h 0C50 ms dv/dt power supply ramp time (slew rate) C C 0.1 v/ ? s v dd io_h v dd _reg t3 t5 extclk s clk t4 s data t1 t2 t7 t6 v dd io_s, v dd io_otpm, v dd a_dac, v dd _phy (when using hispi) dv/dt dv/dt dv/dt
ap0100cs/d rev. 6, pub. 1/16 en 13 ?semiconductor components industries, llc,2016 part number: image signal processor (isp) on-chip regulator table 7: output states name hardware states firmware states notes reset state default state hard standby soft standby streaming idle extclk (clock running or stopped) (clock running) (clock running or stopped) (clock running) (clock running) (clock running) input xtal n/a n/a n/a n/a n/a n/a input reset_bar (asserted) (negated) (negated ) (negated) (negated) (negated) input s clk n/a n/a (clock running or stopped) (clock running or stopped) (clock running or stopped) (clock running or stopped) input. must always be driven to a valid logic level s data high- impedance high- impedance high- impedance high- impedance input/output. a valid logic level should be established by pull-up s addr n/a n/a n/a n/a n/a n/a input. must always be driven to a valid logic level frame_sync n/a n/a n/a n/a n/a n/a input. must always be driven to a valid logic level standby n/a (negated) (asserted) (negated) (negated) (negated) input. must always be driven to a valid logic level ext_reg n/a n/a n/a n/a n/a n/a input. must always be driven to a valid logic level enldon/an/an/an/an/an/ainp ut. must be tied to v dd _reg or gnd spi_sclk high- impedance driven, logic 0 driven, logic 0 driven, logic 0 output spi_sdi internal pull- up enabled internal pull- up enabled internal pull- up enabled internal pull- up enabled input. internal pull-up permanently enabled. spi_sdo high- impedance driven, logic 0 driven, logic 0 driven, logic 0 output spi_cs_bar high- impedance driven, logic 1 driven, logic 1 driven, logic 1 output ext_clk_out driven, logic 0 driven, logic 0 driven, logic 0 driven, logic 0 output reset_bar_o ut driven, logic 0 driven, logic 0 driven, logic 1 driven, logic 1 output. firmware will release sensor reset m_s clk high- impedance high- impedance high- impedance high- impedance input/output. a valid logic level should be established by pull-up m_s data high- impedance high- impedance high- impedance high- impedance input/output. a valid logic level should be established by pull-up fv_in ,lv_in, pixclk_in, din[11:0] n/a n/a n/a n/a dependent on interface used n/a input. must always be driven to a valid logic level
ap0100cs/d rev. 6, pub. 1/16 en 14 ?semiconductor components industries, llc,2016 part number: image signal processor (isp) on-chip regulator clk_n disabled disabled dependent on interface used dependent on interface used dependent on interface used dependent on interface used input. will be disabled and can be left floating clk_p data0_n data0_p data1_n data1_p fv_out, lv_out, pixclk_out, dout[15:0] high- impedance varied driven if used driven if us ed driven if used driven if used output. default state dependent on configuration dac_pos varied varied driven if used driven if used driven if used driven if used output. default state dependent on configuration. tie to ground if vdac not used dac_neg dac_ref n/a n/a n/a n/a n/a n/a input. requires reference resistor. tie to ground if vdac not used gpio[5:2] high- impedance input, then high- impedance driven if used driven if used driven if used driven if used input/output. after reset, these pins are sampled as inputs as part of auto- configuration. gpio1 high- impedance high- impedance high- impedance high- impedance high- impedance high- impedance trigger_out high- impedance high- impedance driven if used driven if used driven if used driven if used trst_bar n/a n/a (negated) (negated) (negated) (negated) input. must always be driven to a valid logic level. table 7: output states name hardware states firmware states notes reset state default state hard standby soft standby streaming idle
ap0100cs/d rev. 6, pub. 1/16 en 15 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) on-chip regulator hard reset the ap0100cs enters the reset state when th e external reset_bar signal is asserted low, as shown in figure 7. all the output signals will be in high-z state. figure 7: hard reset operation soft reset a soft reset sequence to the ap0100 cs can be activated by writing to a register through the two-wire serial interface. hard standby mode the ap0100cs can enter hard standby mode by using external standby signal, as shown in figure 8. entering standby mode 1. assert standby signal high. table 8: hard reset symbol definition min typ max unit t 1 reset_bar pulse width 50 C C extclk cycles t 2 active extclk required af ter reset_bar asserted 10 C C t 3 active extclk required before reset_bar de- asserted 10 C C t 4 first two-wire serial interface communication after reset is high 100 C C extclk reset reset_bar mode t 2 t 3 t 1 internal initialization time s data enter streaming mode t 4 all outputs data active data active
ap0100cs hdr: image signal processor (isp) on-chip regulator ap0100cs/d rev. 6, pub. 1/16 en 16 ?semiconductor components industries, llc,2016. exiting standby mode 1. de-assert standby signal low. figure 8: hard standby operation table 9: hard standby signal timing symbol parameter min typ max unit t 1 standby entry complete C C 2 frames lines t 2 active extclk required after going into standby mode 10 C C extclks t 3 active extclk required before standby de-asserted 10 C C extclks extclk standby standby asserted t 1 standby mode extclk disabled t 2 t 3 extclk enabled mode
ap0100cs/d rev. 6, pub. 1/16 en 17 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) multi-camera synchronization support multi-camera synchronization support the ap0100cs supports multi-camera synchr onization through the frame_sync pin. the behavior will be different depending if the user is using interlaced or progressive mode. when using the interlaced modes, on the risi ng edge of frame_sync this will cause the output to stop the current frame (a) and du ring b the image output will be indetermi- nate. on the falling edge of frame_sync th is will cause the re-synchronization to begin, this will continue for a period (c), during c black fields will be output. the re- synchronized interlaced signal will be available at d. during c if the user toggles the frame_sync input the ap0100cs will ignore it, the user cannot re-synchronize again until at d. figure 9: frame sync be havior with interlaced mode when using progressive mode, the host (or co ntrolling entity) ?broadcasts? a sync-pulse to all cameras within the system that trigge rs capture. the ap0100at will propagate the signal to the trigger_out pin, and subseq uently to the attached sensor's trigger pin. the ap0100cs supports two different trigger modes when using progressive output. the first mode supported is ?single-shot?; this is when the trigger pulse will cause one frame to be output from the image se nsor and ap0100cs (see figure 10). figure 10: single-shot mode note: this diagram is not to scale. the second mode supported is called 'continuous', this is when a trigger pulse will cause the part to continuously output frames, se e figure 11. this mode would be especially useful for applications which have multiple sensors and need to have their video streams synchronized (for example, surroun d view or panoramic view applications). frame_sync cvbs output (ntsc/pal) a b cd frame_sync trigger_out fv_out
ap0100cs hdr: image signal processor (isp) multi-camera synchronization support ap0100cs/d rev. 6, pub. 1/16 en 18 ?semiconductor components industries, llc,2016. figure 11: continuous mode note: this diagram is not to scale. when two or more cameras have a signal a pplied to the frame_sync input at the same time, the respective fv_out signals would be synchronized within 5 pixclk_out cycles. this assumes th at all cameras have the same conf iguration settings and that the exposure time is the same. frame_sync trigger_out fv_out
ap0100cs/d rev. 6, pub. 1/16 en 19 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) image flow processor image flow processor image and color processing in the ap0100cs is implemented as an image flow processor (ifp) coded in hardware logic. during norm al operation, the embedded microcontroller will automatically adjust the operating parameters. for normal operation of the ap0100cs, streams of raw image data from th e attached image sensor are fed into the color pipeline. the user also has the option to select a number of test patterns to be input instead of sensor data. the ifp is broken down into different sections, as outlined in figure 12. figure 12: ap0100cs ifp linear or com panded data d efect correction , noise reduction rx decom panding black level subtraction , d igital gain control , pga raw 12- or 20-bit bayer ae, fd and altm stats 1 2 - bit altm bayer color interpolation altm color correction aperture c orrection gamma rgb2yuv aw b stats color kill yuv filters scaler crop progressive test pattern generator ste interlacer overlay raw bayer altm bayer rgb ycbcr pal/ntsc test patterns pal/ntsc encode dac progressive (ycbcr or bayer ) ccir656 (ycbcr) ntsc/ pal (ycbcr)
ap0100cs hdr: image signal processor (isp) test patterns ap0100cs/d rev. 6, pub. 1/16 en 20 ?semiconductor components industries, llc,2016. test patterns the ap0100cs has a number of test patterns that are available wh en using the progres- sive, ntsc and pal modes. the test patterns can be selected by programming variables. to enter test pattern mode, set r0xc88f to 0x02 and issue a change-config request; to exit this mode, set r0xc88f to 0x00, and issue a change-config request. ntsc and pal test patterns can only be select ed when the device is configured for inter- laced operation. progressive test patterns figure 13: progressive test patterns test pattern example flat field reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x01 // cam_mode_test_pattern_select reg= 0xc890, 0x000fffff // cam_mode_test_pattern_red reg= 0xc894, 0x000fffff // cam_mode_test_pattern_green reg= 0xc898, 0x000fffff // cam_mode_test_pattern_blue load = change-config changing the values in r0xc890-r0x898 will change the color of the test pattern (will require a refresh operation). 100% color bar reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x02 // cam_mode_test_pattern_select load = change-config pseudo-random reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x05 // cam_mode_test_pattern_select load = change-confi g linear ramp reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x09 // cam_mode_test_pattern_select load = change-config fade-to-gray reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x08 // cam_mode_test_pattern_select load = change-config
ap0100cs/d rev. 6, pub. 1/16 en 21 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) test patterns ntsc test patterns figure 14: ntsc test patterns test pattern example eia full field 7 color bars reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x14 // cam_mode_test_patttern_select load = change-config eia full field 8 color bars reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x15 // cam_mode_test_pattern_select load = change-config smpte eg 1-1990 reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x16 // cam_mode_test_pattern_select load = change-confi g eia full field 8 color bars 100 ire reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x17 // cam_mode_test_pattern_select load = change-config
ap0100cs hdr: image signal processor (isp) test patterns ap0100cs/d rev. 6, pub. 1/16 en 22 ?semiconductor components industries, llc,2016. pal test patterns figure 15: pal test patterns each ntsc/pal test pattern consists of seve n or eight color bars (white, yellow, cyan, green, magenta, red, blue and optionally black) . the y, cb and cr values for each bar are detailed in table 10. for the ntsc smpte test pattern it is also required to generate -i, +q, -4 black and +4 black. table 10: ntsc/pal test pattern values nominal range white 100% white 75% yellow cyan green magent a red blue black -i -q -4 black +4 black y 16 to 235 235 180 162 131 112 84 65 35 16 16 16 7 25 cb 16 to 240 128 128 44 156 72 184 100 212 128 156 171 128 128 cr 16 to 240 128 128 142 44 58 198 212 114 128 97 148 128 128 test pattern example ebu full field 7 color bars reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x1e // cam_mode_test_pattern_select load = change-config ebu full field 8 color bars reg= 0xc88c, 0x02 // cam_mode_select reg= 0xc88f, 0x1f // cam_mode_test_pattern_select load = change-config
ap0100cs/d rev. 6, pub. 1/16 en 23 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) test patterns figure 16: test pattern defect correction image stream processing comme nces with the defect corre ction function immediately after data decompanding. to obtain defect free images, the pixels marked defective during sensor readout and the pixels determined defective by the defect co rrection algorithms are replaced with values derived from the non-defectiv e neighboring pixels. this image processing technique is called defect correction. adacd (adaptive color difference) automotive applications require good performance in extremely low light, even at high temperature conditions. in these stringent conditions the image sensor is prone to higher noise levels, and so efficient noise reduction techniques are required to circum- vent this sensor limitation and deliver a high quality image to the user. the adacd noise reduction filter is able to adapt its noise filtering process to local image structure and noise level, removing most objectionable color noise while preserving edge details. black level subtracti on and digital gain after noise reduction, the pixel data goes th rough black level subtra ction and multiplica- tion of all pixel values by a programmable di gital gain. independent color channel digital gain can be adjusted with registers. black level subtraction (to compensate for sensor data pedestal) is a single value applied to all color channels. if the black level subtraction produces a negative result for a particular pixel, the value of this pixel is set to 0.
ap0100cs hdr: image signal processor (isp) test patterns ap0100cs/d rev. 6, pub. 1/16 en 24 ?semiconductor components industries, llc,2016. positional gain adjustments (pga) lenses tend to produce images whose brightness is significantly attenuated near the edges. there are also other factors causing fixed pattern signal gradients in images captured by image sensors. the cumulative re sult of all these factors is known as image shading. the ap0100cs has an embedded sh ading correction module that can be programmed to counter the shading effects on each individual r, gb, gr, and b color signal. the correction function the correction functions can then be applie d to each pixel value to equalize the response across the image as follows: (eq 1) where p are the pixel values and f is the color dependent correction functions for each color channel. p corrected row, col ?? p sensor row, col ?? f(row, col) ? =
ap0100cs/d rev. 6, pub. 1/16 en 25 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) test patterns adaptive local tone mapping (altm) real world scenes often have very high dy namic range (hdr) that far exceeds the elec- trical dynamic range of the imager. dynamic range is defi ned as the luminance ratio between the brightest and the darkest object in a scene. in recent years many technolo- gies have been developed to capture the fu ll dynamic range of real world scenes. for example, the multiple exposure method is widely adopted for capturing high dynamic range images, which combines a series of lo w dynamic range images of the same scene taken under different exposure times into a single hdr image. even though the new digital imaging technolo gy enables the capture of the full dynamic range, low dynamic range disp lay devices are the limiting factor. today?s typical lcd monitor has contrast ratio around 1,000:1; however, it is not typical for an hdr image (the contrast ratio for an hdr image is ar ound 250,000:1). therefore, in order to repro- duce hdr images on a low dynamic range display device, the captured high dynamic range must be compressed to the available range of the display device. this is commonly called tone mapping. tone mapping methods can be classified into global to ne mapping and local tone mapping. global tone mapping methods apply the same mapping function to all pixels. while global tone mapping methods provid e computationally simple and easy to use solutions, they often cause loss of contrast and detail. a local tone mapping is thus necessary in addition to glob al tone mapping for the repr oduction of visually more appealing images that also reveal scene deta ils that are important for automotive safety and surveillance applications. local tone mapping methods use a spatially variable mapping function determined by the neighborhood of a pixel, which allows it to increase the local contrast and the visibility of some details of the image. local methods usually yield more pleasing results because they exploit the fact that human vision is more sensitive to local contrast. on semiconductor?s altm solution significan tly improves the perf ormance over global tone mapping. altm is directly applied to the bayer domain to compress the dynamic range from 20-bit to 12-bit. this allows the regular color pipeline to be used for hdr image rendering. color interpolation in the raw data stream fed by the external sens or to the ifp, each pixel is represented by a 20- or 12-bit integer number, which can be considered proportional to the pixel's response to a one-color light stimulus, red, gr een, or blue, dependin g on the pixel's posi- tion under the color filter array. initial data processing steps, up to and including altm, preserve the one-color-per-pixel nature of th e data stream, but after altm it must be converted to a three-colors-per-pixel stream appropriate for standa rd color processing. the conversion is done by an edge-sensitive color interpolation module. the module pads the incomplete color information av ailable for each pixel with information extracted from an appropriate set of neighboring pixels. the algorithm used to select this set and extract the information seeks the best compromise between preserving edges and filtering out high frequency noise in flat field areas. the edge threshold can be set through register settings.
ap0100cs hdr: image signal processor (isp) test patterns ap0100cs/d rev. 6, pub. 1/16 en 26 ?semiconductor components industries, llc,2016. color correction and aperture correction to achieve good color fidelity of the ifp output, interpolated rgb values of all pixels are subjected to color correction. the ifp multiplies each vector of three pixel colors by a 3 x 3 color correction matrix. the three componen ts of the resulting color vector are all sums of three 10-bit numbers. the color co rrection matrix can be either programmed by the user or automatically selected by th e auto white balance (awb) algorithm imple- mented in the ifp. color correction should ideally produce output colors that are corrected for the spectral sensitivity and co lor crosstalk characteristics of the image sensor. the optimal values of the color co rrection matrix elements depend on those sensor characteristics and on the spectrum of light incident on the sensor. the color correction variables can be adjusted through register settings. traditionally this would have been derived from two sets of ccm, on e for warm light like tungsten and the other for daylight (the part would interpolate between the two matrices). this is not an optimal solution for cameras used in a cool white fluorescent (cwf) environment. a better solution is to provide three ccms, which would include a matrix for cwf (interpolation now between three matrices). the ap0100cs offers this feature which will give the user improved color fidelity when under cwf type lighting. to increase image sharpness, a programmable 2d aperture correction (sharpening filter) is applied to color-corrected image data. the gain and threshold for 2d correction can be defined through register settings. gamma correction the gamma correction curve is implemented as a piecewise linear function with 33 knee points, taking 12-bit arguments and mapping th em to 10-bit output. the abscissas of the knee points are fixed at 0, 8, 16, 24, 32, 40, 48, 56, 64, 80, 96, 112, 128, 160, 192, 224, 256, 320, 384, 448, 512, 640, 768, 896, 1024, 1280, 1536, 1792, 2048, 2560, 3072, 3584, and 4096. the 10-bit ordinates are programmable through variables. the ap0100cs has the ability to calculate the 33-point knee points based on the tuning of cam_ll_gamma and cam_ll_contrast_gradie nt_bright. the other method is for the host to program the 33 knee point curve themselves. also included in this block is a fade-to black curve which sets all knee points to zero and causes the image to go black in extreme low light conditions. color kill to remove high-or low-light color artifacts, a co lor kill circuit is included. it affects only pixels whose luminance exceeds a certain preprogrammed threshold. the u and v values of those pixels are attenuated proportionally to the difference between their lumi- nance and the threshold. yuv color filter as an optional processing step, noise suppres sion by one-dimensional low-pass filtering of y and/or uv signals is possible. a 3- or 5-tap filter can be selected for each signal.
ap0100cs/d rev. 6, pub. 1/16 en 27 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) camera control and auto functions camera control and auto functions auto exposure the auto exposure algorithm optimizes scene exposure to minimize clipping and satu- ration in critical areas of the image. this is achieved by controlling exposure time and analog gains of the external sensor as we ll as digital gains applied to the image. auto exposure is implemented by a firm ware algorithm that is running on the embedded microcontroller that analyzes imag e statistics collected by the exposure measurement engine, makes a decision, and programs the sensor and color pipeline to achieve the desired exposure. the measurement engine subdivides the image into 25 windows organized as a 5 x 5 grid. figure 17: 5 x 5 grid ae track driver other algorithm features include the rejection of fast fluctuations in illumination (time averaging), control of speed of response, and control of the sensitivity to small changes. while the default settings are adequate in mo st situations, the user can program target brightness, measurement window, and other parameters described above. the driver changes ae parameters (integrati on time, gains, and so on) to drive scene brightness to the programmable target. to avoid unwanted reaction of ae on smal l fluctuations of scen e brightness or momen- tary scene changes, the ae track driver uses a temporal filter for luma and a threshold around the ae luma target. the driver changes ae parameters only if the filtered luma is larger than the ae target step and pushes the luma beyond the threshold.
ap0100cs hdr: image signal processor (isp) camera control and auto functions ap0100cs/d rev. 6, pub. 1/16 en 28 ?semiconductor components industries, llc,2016. auto white balance the ap0100cs has a built-in awb algorithm de signed to compensate for the effects of changing spectra of the scene illumination on the quality of the color rendition. the algorithm consists of two major parts: a measurement engine performing statistical analysis of the image and a driver performi ng the selection of the optimal color correc- tion matrix and ifp digital gain. while defaul t settings of these algorithms are adequate in most situations, the user can reprogram base color correction matrices, place limits on color channel gains, and control the speed of both matrix and gain adjustments. the ap0100 csawb displays the current awb position in color temperature, the range of which will be defined when programming the ccm matrixes. the region of interest can be controlled through the combination of an inclusion window and an exclusion window. exposure and white balance control the sensor manager firmware component is responsible for controlling the application of 'exposure' and 'white balance' within the system. this effectively means that all control of integration times and gains (whether for exposure or white balance) is dele- gated to the sensor manager. the auto ex posure (ae) and auto white balance (awb) algorithms use services provided by the sensor manager to apply exposure and/or white balance changes. dual band ircf for some applications a day/night filter would be switched in/out, this option is an additional cost to the camera system. the ap 0100cs supports the use of dual band ircf, which removes the need for the switching day/ night filter. tuning support is provided for this usage case. refer to the ap0100cs developer guide for details. exposure and white balance modes the ap0100cs supports auto and manual expo sure and white balance modes. in addi- tion, it will operate within synchronized mu lti-camera systems. in this use case, one camera within the system will be the 'master' , and the others 'slaves'. the master is used to calculate the appropriate exposure and wh ite balance. this is then applied to all slaves concurrently under host control. auto mode in auto exposure mode the ae algorithm is responsible for calculating the appropriate exposure to keep the desired scene brightne ss, and for applying the exposure to the underlying hardware. in auto white balance mode the awb algorithm is responsible for calculating the color temperature of the sc ene and applying the appropriate red and blue gains to compensate. triggered auto mode the triggered auto exposure and triggered auto white balance modes are intended for the multi-camera use cases, where a host is controlling the exposure and white balance of a number of cameras. the idea is that one camera is in triggered-auto mode (the master), and the others in host-controlled mode (slaves). the master camera must calculate the exposure and gains, the host then copies this to the slaves, and all changes are then applied at the same time.
ap0100cs/d rev. 6, pub. 1/16 en 29 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) flicker avoidance manual mode manual mode is intended to allow simple manual exposure and white balance control by the host. the host needs to set th e cam_aet_exposure_time_ms, cam_aet_ex- posure_gain and cam_awb_color_temper ature controls, the camera will calculate the appropriate integration times and gains. host controlled the host controlled mode is intended to gi ve the host full control over exposure and gains flicker avoidance flicker occurs when the integration time is not an integer multiple of the period of the light intensity. the ap0100cs can be programm ed to avoid flicker for 50 or 60 hertz. for integration times below the light intensity period (10ms for 50hz environment), flicker cannot be avoided. the ap0100cs supports an indoor ae mode, that will ensure flicker- free operation. flicker detection the ap0100cs supports flicker detection, the algorithm is designed only to detect a 50hz or 60hz flicker source. output formatting the pixel output data in ap0100cs will be transmitted as an 8/10 bit word over one or two clocks. uncompressed ycbcr data ordering the ap0100cs supports swapping ycbcr mode, as illustrated in table 11. the data ordering for the ycbcr output modes for ap0100cs are shown in table 12: table 11: ycbcr output data ordering mode data sequence default (no swap) cbi yi cri yi+1 swapped crcb cri yi cbi yi+1 swapped yc yi cbi yi+1 cri swapped crcb, yc yi cri yi+1 cbi table 12: ycbcr output modes (c am_port_parallel_msb_align=0x1) mode byte pixel i pixel i+1 notes ycbcr_422_8_8 odd (d out [15:8]) cbi cri data range of 0-255 (y=16-235 and c=16-240) even (d out [15:8]) yi yi+1 ycbcr_422_10_10 odd (d out [15:6]) cbi cri data range of 0-1023 (y=64-940 and c=64- 960) even (d out [15:6]) yi yi+1 ycbcr_422_16 single (d out [15:0]) cbi_yi cri_yi+1 data range of 0-255 (y=16-235 and c=16-240)
ap0100cs hdr: image signal processor (isp) output formatting ap0100cs/d rev. 6, pub. 1/16 en 30 ?semiconductor components industries, llc,2016. note: odd means first cycle; even means second cycle. figure 18: 8- bit ycbcr output (ycbcr_422_8_8) notes: 1. cb y cr y by default. 2. cam_port_paralle l_msb_align=0x0 table 13: ycbcr output modes (c am_port_parallel_msb_align=0x0) mode byte pixel i pixel i+1 ""notes" ycbcr_422_8_8 odd (d out [7 :0]) cbi cri data range of 0-255 (y=16-235 and c=16-240) even (d out [7:0] yi yi+1 ycbcr_422_10_10 odd (d out [9:0]) cbi cri data range of 0-1023 (y=64-940 and c=64-960)" even (d out [9:0]) yi yi+1 ycbcr_422_16 single (d out [15:0]) cbi_yi cri_yi+1 data range of 0-255 (y=16-235 and c=16-240) active video y cb y cr y cb y cr y cb y cr ycbycr image image hblank hblank hblank vertical blanking ycbycr vblank image vblank ycbycr image ycbycr ycbycr ycbycr ycbycr image image hblank hblank hblank 00 00 00 00 cr cr cr line valid frame valid pixel clock data[15:8] data[7:0] line valid frame valid pixel clock data[15:8] data[7:0] line valid frame valid pixel clock data[15:8] data[7:0] porch ? 0-255 cycles line valid frame valid pixel clock data[15:8] data[7:0] porch ? 0-255 cycles porch ? 0-255 cycles porch ? 0-255 cycles
ap0100cs/d rev. 6, pub. 1/16 en 31 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) output formatting figure 19: 10-bit ycbcr output (ycbcr_422_10_10) notes: 1. cb y cr y by default. 2. cam_port_paralle l_msb_align=0x1 active video y cb y cr y c b y c r y cb y cr ycby cr image image hblank hblank hblank vertical blanking ycbycr vblank image vblank ycb y cr image y cb y cr y cb y c r y cb y cr ycby cr image image hblank hblank hblank 00 00 00 00 cr cr cr line valid frame valid pixel clock data[5:0] data[15:6] line valid frame valid pixel clock data[5:0] data[15:6] line valid frame valid pixel clock data[5:0] data[15:6] line valid frame valid pixel clock data[5:0] data[15:6] porch ? 0-255 cycles porch ? 0-255 cycles porch ? 0-255 cycles porch ? 0-255 cycles
ap0100cs hdr: image signal processor (isp) output formatting ap0100cs/d rev. 6, pub. 1/16 en 32 ?semiconductor components industries, llc,2016. figure 20: 16-bit ycbcr output (ycbcr_422_16) active video cb cr cb c r cb cr cb c r cb cr cb cr cb cr cb c r image image hblank hblank hblank vertical blanking cbcr cbcr vblank image vblank cbcr cbcr image image image hblank hblank hblank cr cr yyyy yyyy yyyy yyyy y cb cr cb cr cb cr cb c r cb cr cb c r cb cr cb c r cr yy y y yyyy yyyy yyyy y yyyy yyyy y line valid frame valid pixel clock data[7:0] data[15:8] line valid frame valid pixel clock data[7:0] data[15:8] line valid frame valid pixel clock data[7:0] data[15:8] line valid frame valid pixel clock data[7:0] data[15:0] porch ? 0-255 cycles porch ? 0-255 cycles porch ? 0-255 cycles porch ? 0-255 cycles
ap0100cs/d rev. 6, pub. 1/16 en 33 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) output formatting figure 21: typical ccir656 output data[7:0] line valid frame valid field 1 cbycry cbycry 80 10 80 10 80 10 10 80 10 80 10 80 10 80 10 cb y cr y ff 00 00 80 80 ff 00 00 9d ff 00 00 80 cb y cr y 80 10 80 10 ff 00 00 9d sav image eav sav image eav hblank hblank blanking blanking blanking hblank data[7:0] line valid frame valid cbycry cbycry 80 10 80 10 80 10 10 80 10 80 10 80 10 80 10 80 10 80 10 ff 00 00 80 80 ff 00 00 b6 ff 00 00 ab 80 10 80 10 80 10 80 10 ff 00 00 b6 sav image eav blank sav blank vblank eav blank hblank hblank blanking blanking blanking hblank pixel clock pixel clock data[7:0] line valid frame valid cbycry cbycry 80 10 80 10 80 10 10 80 10 80 10 80 10 80 10 cb y cr y ff 00 00 c7 80 ff 00 00 da ff 00 00 c7 cb y cr y 80 10 80 10 ff 00 00 da sav image eav sav image eav hblank hblank blanking blanking blanking hblank data[7:0] line valid frame valid cbycry cbycry 80 10 80 10 80 10 10 80 10 80 10 80 10 80 10 80 10 80 10 ff 00 00 c7 80 ff 00 00 f1 ff 00 00 ec 80 10 80 10 80 10 80 10 ff 00 00 f1 sav image eav blank sav blank vblank eav blank hblank hblank blanking blanking blanking hblank pixel clock pixel clock field 2 data[15:8] 00 data[15:8] 00 data[15:8] 00 data[15:8] 00
ap0100cs hdr: image signal processor (isp) output formatting ap0100cs/d rev. 6, pub. 1/16 en 34 ?semiconductor components industries, llc,2016. figure 22: typical cvbs output (ntsc/pal) line valid in frame valid in field 1 / 3 pre-equalisation pulses post-equalising pulses serration pulses video 1 2 3 4 5 6 7 8 9 line valid in frame valid in field 2 / 4 pre-equalisation pulses post-equalising pulses serration pulses video 1 2 3 4 5 6 7 8 9 line valid to first field latency ~= ste latency + 1 field
ap0100cs/d rev. 6, pub. 1/16 en 35 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) bayer modes bayer modes bayer output modes are only available in prog ressive output mode before ste. the data ordering for the altm bayer output mo des for ap0100cs are shown in table 14. table 14 and table 15 show lsb aligned data; it is possible using register setting to obtain msb aligned data. the data ordering for the bayer output modes for ap0100cs are shown in table 15. note: bayer_12 can be selected by setting cam_mo de_select = 0x1 and requesting a change-config operation. sensor embedded data the ap0100cs is capable of passing sensor em bedded data in bayer output mode only. the ap0100cs statistics are available through th e serial interface. refer to the developer guide for details. table 14: altm bayer output modes mode byte d1 5 d1 4 d1 3 d1 2 d11 d10 d9 d8 d7 d6 d5 d4 d3 d2 d1 d0 altm_bayer_10 single 0 0 0 0 0 0 d9 d98 d7 d6 d5 d4 d3 d2 d1 d0 altm_bayer_12single0000d11d10d9d8d7d6d5d4d3d2d1d0 table 15: bayer output modes mode byte d15 d14 d13 d12 d11 d10 d9 d8 d7 d6 d5 d4 d3 d2 d1 d0 notes bayer_1 2 singl e 0000d11d10d9d8d7d6d5d4d3d2d1d0raw bayer data
ap0100cs hdr: image signal processor (isp) spatial transform engine (ste) ap0100cs/d rev. 6, pub. 1/16 en 36 ?semiconductor components industries, llc,2016. spatial transform engine (ste) a spatial transform is defined as a transform in which some pixels are in different posi- tions within the input and output pictures . examples include z oom, lens distortion correction, turn, and rotate. ste is a fully programmable engine which can perform spatial transforms and eliminates the need for an expensive dsp for image correction. lens distortion correction automotive backup cameras typically feature a wide fov lens so that a single camera mounted above the center of the rear bumper can present the driver with a view of all potential obstacles immediately behind the full width of the vehicle. lenses with a wide field of view typically exhi bit at least a noticeable am ount of barrel distortion. barrel distortion is caused by a reduction in object magnif ication the further away from the optical axis. for the image to appear natural to the driver, the ap0100cs corrects this barrel distor- tion and reprocesses the image so that the resu lting distortion is much smaller. this is called distortion correction. distortion correction is the ability to digitally correct the lens barrel distortion and to provide a natural view of objects. in addition, with barrel distortion one can adjust the perspective vi ew to enhance the visibility by virtually elevating the point of viewing objects. pan, tilt, zoom and rotate using the ste it is possible to implement ima ge transformations like pan, tilt, zoom and rotate. figure 23: uncorrected image
ap0100cs/d rev. 6, pub. 1/16 en 37 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) spatial transform engine (ste) figure 24: zoomed figure 25: zoom and look left
ap0100cs hdr: image signal processor (isp) overlay capability ap0100cs/d rev. 6, pub. 1/16 en 38 ?semiconductor components industries, llc,2016. figure 26: zoom and look right overlay capability figure 27 highlights the graphical overlay da ta flow of the ap0100cs. the images are separated to fit into 4kb blocks of memory after compression. ? up to seven overlays may be blended simultaneously ? overlay size up to 720 x 576 pixels rendered ? selectable readout: rotating order is user programmable ? dynamic movement through predefined overlay images ? palette of 32 colors out of 16 million with 16 colors per bitmap ? each color has a ycbcr (8-8-8 bit) and 8 bits for the alpha value (transparency). ? each layer has a built in fader which when enabled scales the alpha value for each pixel. ? blend factors may be changed dynami cally to achieve smooth transitions the overlay engine is controlled through ho st commands that allow a bitmap to be written piecemeal to a memory buffer thro ugh the two-wire serial interface, and through a dma chanel direct from spi flash memory. multiple encoding passes may be required to fit an image into a 4kb block of memory; alternatively, the image can be divided into two or more blocks to make th e image fit. every graphic image may be posi- tioned in an x/y direction and ov erlap with other graphic images. the host may load an image at any time. un der control of dma assist, data are trans- ferred to the off-screen buffer in compressed form. this assures that no display data are corrupted during the replenishment of the seven active overlay buffers.
ap0100cs/d rev. 6, pub. 1/16 en 39 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) overlay capability figure 27: overlay data flow note: these images are not actually rendered, but show conceptual object s and object blending. off-screen buffer overlay buffers: 4kb each decompress blend and overlay nvm bitmaps - compressed
ap0100cs hdr: image signal processor (isp) serial memory partition ap0100cs/d rev. 6, pub. 1/16 en 40 ?semiconductor components industries, llc,2016. serial memory partition the contents of the flash/eeprom memory pa rtition logically into three blocks (see figure 28): ? memory for overlay data and descriptors ? memory for register settings, which may be loaded at boot-up ? firmware extensions or software patches; in addition to the on-chip firmware, exten- sions reside in this block of memory these blocks are not necessarily contiguous. figure 28: memory partitioning s/w patch alternate reg. setting overlay data flash partitioning fixed size overla y s-rle 12byte header rle encoded data 2kbyte fixed size overla y s-rle lens correction parameter fixed-size overlays ? rle fixed-size overlays ? rle flash partitioning overlay data software patch 12-byte header rle encoded data 2kb lens shading correction parameter alternate register setting 4kb
ap0100cs/d rev. 6, pub. 1/16 en 41 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) overlay adjustment overlay adjustment to ensure a correct position of the overlay to compensate for assembly deviation, the overlay can be adjusted with assistance from the calibration statistics engine: ? the calibration statistics en gine supports a windowed 8-bin luma histogram, either row-wise (vertical) or column-wise (horizontal). ? the example calibration statistics function of the firmware can be used to perform an automatic successive approximation search of a cross-hair target within the scene. ? on the first frame, the firmware performs a coarse horizontal search, followed by a coarse vertical search in the second frame. ? in subsequent frames, the fi rmware reduces the re gion-of-interest of the search to the histogram bins containing the greatest accu mulator values, thereby refining the search. ? the resultant x, y location of the cross-hair target can be used to assign a calibration value of offset selected overlay graphic image positions within the output image. ? the calibration statistics also supports a ma nual mode, which allows the host to access the raw accumulator values directly. composite video output the external pin gpio[3] can be used to configure the device for default ntsc or pal operation. this and other vide o configuration settings are available as register settings accessible through th e serial interface. single-ended and differen tial composite output the composite output can be operated in a single-ended or differential mode by simply changing the external resistor configurat ion. for single-ended termination, see figure 29 on page 41. the differential schematic is shown in figure 30 on page 42. figure 29: single-ended termination the dac is differential, but it may be used to produce single-ended signals provided that the unused (dac_neg) output is terminated into a resistance to ground approximately equal to the load on the dac_pos output. wi thout this termination, the internal bias
ap0100cs hdr: image signal processor (isp) overlay adjustment ap0100cs/d rev. 6, pub. 1/16 en 42 ?semiconductor components industries, llc,2016. circuits will not be kept in their proper operating regions and the dynamic performance of the dac will be degraded. termination straight into ground causes all of the power dissipation to occur on the chip, which is undesirable. if a one component saving was absolutely critical, termination straight to ground is a possibility. figure 30: differential connection if the user is not using the analog output then figure 31 shows how the signals should be connected. figure 31: no dac
ap0100cs/d rev. 6, pub. 1/16 en 43 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) slave two-wire seri al interface (ccis) slave two-wire serial interface (ccis) the two-wire slave serial inte rface bus enables read/write access to control and status registers within the ap0100cs. the interface protocol uses a master/slave model in which a master controls one or more slave devices. protocol data transfers on the two-wire serial inte rface bus are performed by a sequence of low-level protocol elements, as follows: ? a start or restart condition ? a slave address/da ta direction byte ? a 16-bit register address ? an acknowledge or a no-acknowledge bit ?data bytes ? a stop condition the bus is idle when both s clk and s data are high. control of the bus is initiated with a start condition, and the bus is released wi th a stop condition. only the master can generate the start an d stop conditions. the s addr pin is used to select between two different addresses in case of conflict with another device. if s addr is low, the slave address is 0x90; if s addr is high, the slave address is 0xba. see table 16 below. the user can change the slave address by changing a register value. start condition a start condition is defined as a high-to-low transition on s data while s clk is high. at the end of a transfer, the master can ge nerate a start conditio n without previously generating a stop condition; this is known as a ?repeated start? or ?restart? condition. data transfer data is transferred serially, 8 bits at a time, with the msb transmitted first. each byte of data is followed by an acknowledge bit or a no-acknowledge bit. this data transfer mechanism is used for the slave address/data direction byte and for message bytes. one data bit is transferred during each s clk clock period. s data can change when s clk is low and must be stable while s clk is high. table 16: two-wire interface id address switching s addr two-wire interface address id 00x90 10xba
ap0100cs hdr: image signal processor (isp) protocol ap0100cs/d rev. 6, pub. 1/16 en 44 ?semiconductor components industries, llc,2016. slave address/data direction byte bits [7:1] of this byte represent the device slave address and bit [0] indicates the data transfer direction. a ?0? in bit [0] indicates a write, and a ?1? indicates a read. the default slave addresses used by the ap0100cs are 0x90 (write address) and 0x91 (read address). alternate slave addresses of 0xba (write address) and 0xbb (read address) can be selected by asserting the s addr input signal. message byte message bytes are used for sending register ad dresses and register write data to the slave device and for retrieving register read data. the protocol used is outside the scope of the two-wire serial inte rface specification. acknowledge bit each 8-bit data transfer is followed by an acknowledge bit or a no-acknowledge bit in the s clk clock period following the data transfer. the transmitter (which is the master when writing, or the slave when reading) releases s data . the receiver indicates an acknowl- edge bit by driving s data low. as for data transfers, s data can change when s clk is low and must be stable while s clk is high. no-acknowledge bit the no-acknowledge bit is generated when the receiver does not drive s data low during the s clk clock period following a data transfer. a no-acknowledge bit is used to termi- nate a read sequence. stop condition a stop condition is defined as a low-to-high transition on s data while s clk is high. typical operation a typical read or write sequence begins by the master generating a start condition on the bus. after the start condition, the master sends the 8-bit slave address/data direction byte. the last bit indicates whether the request is for a read or a write, where a ?0? indicates a write and a ?1? indicates a read. if the address matches the address of the slave device, the slave device acknowledges receipt of the address by generating an acknowledge bit on the bus. if the request was a write, the master then transfers the 16-bit register address to which a write will take place. this transfer take s place as two 8-bit sequences and the slave sends an acknowledge bit after each sequen ce to indicate that the byte has been received. the master will then transfer the 16-bit data, as two 8-bit sequences and the slave sends an acknowledge bit after each sequ ence to indicate that the byte has been received. the master stops writing by generati ng a (re)start or stop condition. if the request was a read, the master sends the 8-bi t write slave address/ data direction byte and 16-bit register address, just as in th e write request. the master then generates a (re)start condition and the 8-bit read slave address/data direction byte, and clocks out the register data, 8 bits at a time. the mast er generates an acknowledge bit after each 8- bit transfer. the data transfer is stopped when the master sends a no-acknowledge bit.
ap0100cs/d rev. 6, pub. 1/16 en 45 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) protocol single read from random location figure 32 shows the typical read cycle of th e host to the ap0100cs. the first two bytes sent by the host are an internal 16-bit regist er address. the following 2-byte read cycle sends the contents of the registers to host. figure 32: single read from random location single read from current location figure 33 shows the single read cycle withou t writing the address. the internal address will use the previous address value written to the register. figure 33: single read from current location sequential read, start from random location this sequence (figure 34) starts in the same way as the single read from random loca- tion (figure 32 on page 45). instead of generating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit and continues to perform byte reads until ?l? bytes have been read. figure 34: sequential read, start from random location s = start condition p = stop condition sr = restart condition a = acknowledge a = no-acknowledge slave to master master to slave slave address 0 s a reg address[15:8] a reg address[7:0] slave address a a 1 sr read data [15:8] p previous reg address, n reg address, m m+1 a read data [7:0] a slave address 1 s a read data [15:8] slave address a 1 s p read data [15:8] p previous reg address, n reg address, n+1 n+2 a a read data [7:0] a read data [7:0] a read data (15:8) a a read data (15:8) a read data (7:0) a slave address 0 s sr a reg address[15:8] a reg address[7:0] a read data slave address previous reg address, n reg address, m m+1 m+2 m+1 m+3 a 1 m+l-2 m+l-1 m+l a p a read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data (7:0)
ap0100cs hdr: image signal processor (isp) protocol ap0100cs/d rev. 6, pub. 1/16 en 46 ?semiconductor components industries, llc,2016. sequential read, start from current location this sequence (figure 35) starts in the same way as the single read from current loca- tion (figure 33). instead of generating a no-a cknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit and continues to perform byte reads until ?l ? bytes have been read. figure 35: sequential read, start from current location single write to random location figure 36 shows the typical wr ite cycle from the host to the ap0100cs.the first 2 bytes indicate a 16-bit address of the internal registers with most-significant byte first. the following 2 bytes indicate the 16-bit data. figure 36: single write to random location a read data read data previous reg address, n n+1 n+2 n+l-1 n+l a read data slave address a a 1 a s p read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data (15:8) a read data (7:0) a read data read data (15:8) a read data (7:0) slave address 0 s a reg add ress[15:8] a reg add ress[7:0] a p previous reg address, n reg addr ess, m m+1 a a wri te data
ap0100cs/d rev. 6, pub. 1/16 en 47 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) protocol sequential write, start at random location this sequence (figure 37) starts in the same way as the single write to random location (figure 36). instead of generating a no-acknowl edge bit after the first byte of data has been transferred, the master generates an acknowledge bit and continues to perform byte writes until ?l? bytes have been writte n. the write is terminated by the master generating a stop condition. figure 37: sequential write, start at random location slave address 0 s a reg address[15:8] write data a reg address[7:0] a write data previous reg address, n reg address, m m+1 m+2 m+1 m+3 a a a write data write data m+l-2 m+l-1 m+l a a p write data (15:8) write data (7:0) write data (15:8) a write data (7:0) a a a a write data a write data (15:8) a write data (7:0) a write data write data (15:8) a write data (7:0)
ap0100cs hdr: image signal processor (isp) protocol ap0100cs/d rev. 6, pub. 1/16 en 48 ?semiconductor components industries, llc,2016. device configuration after power is applied and the device is out of reset (either the power on reset, hard or soft reset), it will enter a boot sequence to configure its operating mode. there are essen- tially three configuration modes: flash/eepr om config, auto config, and host config. the ap0100cs firmware supports a system configuration phase at start-up. this consists of three sub-phases of execution: flash detection, then one of: a. flash config b. auto config c. host config the system configuration phase is entered immediately following power-up or reset. then the firmware performs flash detection. flash detection attempts to detect the pr esence of an spi flash or eeprom device: ? if no device is detected, the firmware then samples the spi_sdi pin state to determine the next mode: ? if spi_sdi is low, then it enters the host-config mode. ? if spi_sdi is high, then it enters the auto-config mode. ? if a device is detected, the firmware switches to the flash-config mode. in the flash-config mode, the firmware in terrogates the device to determine if it contains valid configuration records: ? if no records are detected, then the firmware enters the auto-config mode. ? if records are detected, the firmware processes them. by default, when all flash records are processed the firm ware switches to the host-config mode. however, the records encoded into th e flash can optionally be used to instruct the firmware to proceed to auto-config, or to star t streaming (via a change-config). in the host-config mode, the firmware perf orms no configuration, and remains idle waiting for configuration and commands from the host. the system configuration phase is effectively complete and the ap0100cs will take no actions until the host issues commands. the auto-config mode uses the gpio [5..2] pi ns to configure the operation of the device, such as video format and pedestal (see ta ble 18, ?gpio bit descriptions in auto-config,? on page 49). after auto-config completes the firmware switches to the change-config mode.
ap0100cs/d rev. 6, pub. 1/16 en 49 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) protocol supported spi devices table 17 lists supported eeprom/f lash devices. devices not compatible will require a firmware patch. contact on semico nductor for additional support. notes: 1. has been obsoleted. table 17: spi flash devices manufacturer device type size autodetected manuid atmel at26df081a flash 1mbyte yes 0x1f4501 atmel at25df161 flash 2mbyte yes 0x1f4602 sanyo 1 le25fw806 flash 1mbyte yes 0x622662 st m25p05a flash 64kbyte yes 0x202010 st m25p16 flash 2mbyte yes 0x202015 st m95040 eeprom 512byte no 0x20ffff st m95020 eeprom 256byte no 0x20ffff st m95010 eeprom 128byte no 0x20ffff st m95m01 eeprom 128kbyte no 0x20ffff microchip m25aa080 eepro m 1kbyte no 0x29ffff microchip m25lc080 eeprom 1kbyte no 0x29ffff table 18: gpio bit descriptions in auto-config gpio[5] gpio[4] gpio[3] gpio[2] low (0) normal normal ntsc no pedestal high (1) vertical flip ho rizontal mirror pal pedestal
ap0100cs hdr: image signal processor (isp) host command interface ap0100cs/d rev. 6, pub. 1/16 en 50 ?semiconductor components industries, llc,2016. host command interface the ap0100cs has a mechanism to write hi gher level commands, the host command interface (hci). once a command has been writ ten through the hci, it will be executed by on chip firmware and the results are repo rted back. eeprom or flash memory is also available to store commands for later execution. figure 38: interface structure command flow the host issues a command by writing (throug h the two wire interface) to the command register. all commands are encoded with bit 15 set, which automatically generates the ?host command? (doorbell) interrupt to the microprocessor. assuming initial conditions, the host first writes the command parameters (if any) to the parameters pool (in the command handler? s shared-variable page), then writes the command to command register. the firmware ?s interrupt handler is invoked, which immediately copies the command register co ntents. the interrupt handler then signals the command handler task to process the command. host command to fw response from fw 15 0 bit 1 0 command register addr 0x40 addr 0xfc00 addr 0xfc0e addr 0xfc02 addr 0xfc04 addr 0xfc06 addr 0xfc08 addr 0xfc0a addr 0xfc0c 14 door bell 15 0 bit parameter 0 parameter 7 cmd_handler_params_pool_0 cmd_handler_params_pool_1 cmd_handler_params_pool_2 cmd_handler_params_pool_3 cmd_handler_params_pool_4 cmd_handler_params_pool_5 cmd_handler_params_pool_6 cmd_handler_params_pool_7
ap0100cs/d rev. 6, pub. 1/16 en 51 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) host command interface if the host wishes to determine the outcom e of the command, it must poll the command register waiting for the doorbell bit to become cleared. this indicates that the firmware completed processing the command. the cont ents of the command register indicate the command?s result status. if the comman d generated response parameters, the host can now retrieve these from the parameters pool. the host must not write to the parameters pool, nor issue another command, until the previous command completes. this is true even if the host does not care about the result of the previous command. it is strongly reco mmended that the host tests that the door- bell bit is clear before issuing a command. synchronous command flow the typical ?flow? for synchronous commands is: 1. the host issues a ?request? co mmand to perform an operation. 2. the registered command handler is invo ked, validates the command parameters, then performs the operation. the handler returns the command result status to indi- cate the result of the operation. 3. the host retrieves the command result va lue, and any associated command response parameters. asynchronous command flow the typical ?flow? for asynchronous commands is: 1. the host issues a ?request? command to start an operation. 2. the registered command handler is invo ked, validates and copies the command parameters, then signals a separate task to perform the operation. the handler returns the enoerr return value to indicate the command was acceptable and is in progress. 3. the host retrieves the command return value ? if it is not enoerr the host knows that the command was not accepted and is not in progress. 4. subsequently, the host issu es an appropriate ?get status? command to both poll whether the command has completed, and if so, retrieve any associated response parameters. 5. the registered command handler is invoke d, determines the state of the command (via shared variables with the processing task), and returns either ?ebusy? to indicate the command is still in progress, or it returns the result status of the command. 6. the host must re-issue the ?get status? command until it does not receive the ebusy response. asynchronous commands exist to allow the host to issue multiple commands to the various subsystems without having to wa it for each command to complete. this prevents the host command interface from being blocked by a lo ng-running command. therefore, each asynchronous command has a ?get status? (or similar) command to allow the host to determine when the asynchronous command completes.
ap0100cs hdr: image signal processor (isp) start-up host command lock-out ap0100cs/d rev. 6, pub. 1/16 en 52 ?semiconductor components industries, llc,2016. start-up host command lock-out the ap0100cs firmware implements an intern al host command ?lock?. at start-up, the firmware obtains this lock, which prevents the host from successfully issuing a host command. all host commands will be reject ed with ebusy until the lock is freed. the firmware releases the host command lock when it completes its start-up configura- tion processing. the time to do this is de pendent upon the configuration mechanism. it is recommended that the host poll the de vice with the system manager get state command until enoerr is returned. once the host can send serial commands it should perform the following sequence. 1. poll command_register[15] until it clears (this is called the doorbell bit). 2. continuously issue the sysmgr_get_state command (0x8101) until the result sta- tus is not ebusy below is some pseudocode that a host could use to implement the above sequence: def systemwaitreadyfollowingreset(numretries=10): """api function: waits for the system to be ready following reset (or powerup) - first wait for the doorbell bit to clear - this indicates that the device can accept host commands. - then wait until the system has completed its configuration phase; the system is ready when the sysmgr_get_state command does not return ebusy. - note the time for the system to be ready is dependent upon the active system configuration mode. - numretries is the number of retries before timing-out - returns result status code """ # wait for doorbell bit to clear (indicates device can receive host commands) retries = numretries while (0 != retries): if (reg.command_register.doorbell.uncached_value == 0): break # ready to receive commands retries -= 1 if (0 == retries): # device failed to respond in time return printerror(resultstatus.eio, 'systemwaitreadyfollowingreset failed (doorbell failed to clear)') # wait for the system manager to complete the system configuration phase retries = numretries while (0 != retries): res, currentstate = sysmgrgetstate() if (resultstatus.enoerr == res): break # we're done if (resultstatus.ebusy != res): return printerror(res, 'systemwaitreadyfollowingreset failed (sysmgrgetstate failed)') retries -= 1 if (0 == retries): # device failed to respond in time return printerror(resultstatus.eagain, 'systemwaitreadyfollowingreset failed (device busy)') return res
ap0100cs/d rev. 6, pub. 1/16 en 53 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) multitasking multitasking the ap0100cs firmware is multitasking; therefor e note that it is possible for an inter- nally requested command to be in-progress when the host issues a command. in these circumstances, the host command is immediately rejected with ebusy. the host should reissue the command after a short interval. host commands overview the ap0100cs supports a number of function al modules or proc essing subsystems. each module or subsystem exposes commands to the host to control and configure its operation. command parameters command parameters are written to the parame ters pool shared-variables by the host prior to invoking the command. similarly, any command response parameters are also written back to the parameters pool by the firmware. result status codes table 19 shows the result status codes that are written by the command handler to the host command register, in response to a command. note: any unrecognized host comman ds will be immediately rejected by the command handler, with result status code enosys. table 19: result status codes value mnemonic typical interpretation C each command may re-interpret 0x00 enoerr no error C command was successful 0x01 enoent no such entity 0x02 eintr operation interrupted 0x03 eio i/o failure 0x04 e2big too big 0x05 ebadf bad file/handle 0x06 eagain would-block, try again 0x07 enomem not enough memory/resource 0x08 eacces permission denied 0x09 ebusy entity busy, cannot support operation 0x0a eexist entity exists 0x0b enodev device not found 0x0c einval invalid argument 0x0d enospc no space/resource to complete 0x0e erange parameter out-of-range 0x0f enosys operation not supported 0x10 ealready already requested/exists
ap0100cs hdr: image signal processor (isp) summary of host commands ap0100cs/d rev. 6, pub. 1/16 en 54 ?semiconductor components industries, llc,2016. summary of host commands table 20 on page 54 through table 31 on page 56 show summaries of the host commands. the commands are divided into the following sections: ? system manager ?overlay ?gpio ? flash manager ?ste ? sequencer ? patch loader ?miscellaneous ? calibration stats following is a summary of the host interf ace commands. the description gives a quick orientation. the ?type? column shows if it is an asynchronous or synchronous command. for a complete list of all comman ds including parameters, consult the host command interface specification document. table 20: system manager host command system manager host command value type description set state 0x8100 asynchronous request the system enter a new state get state 0x8101 synchronous get the current state of the system config power manage ment 0x8102 synchronous configures the power state of the system table 21: overlay host commands overlay host command value type description enable overlay 0x8200 synchronous enable or disable the overlay subsystem get overlay state 0x8201 synchronous retrieves the state of the overlay subsystem set calibration 0x8202 synchronous set the calibration offset set bitmap property 0x8203 synchronous set a property of a bitmap get bitmap property 0x8204 synchronous get a property of a bitmap set string property 0x8205 synchronous set a property of a character string load buffer 0x8206 asynchronous load an overlay buffer with a bitmap (from flash) load status 0x8207 synchronous retrieve status of an acti ve load buffer operation write buffer 0x8208 synchronous write directly to an overlay buffer read buffer 0x8209 synchronous read directly from an overlay buffer enable layer 0x820a synchronous enable or disable an overlay layer get layer status 0x820b synchronous retrieve the status of an overlay layer set string 0x820c synchronous set the character string get string 0x820d synchronous get the current character string load string 0x 820e asynchronous load a character string (from flash)
ap0100cs/d rev. 6, pub. 1/16 en 55 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) summary of host commands table 22: ste manager host commands ste manager host command value type description config 0x8310 synchronous configure using the default ntsc or pal configuration stored in rom load config 0x8311 asynchronous load a configuration from spi nvm to the configuration cache load status 0x8312 synchronous get status of a lo ad config request write config 0x8313 synchronous write a configuration (via cci s) to the configuration cache table 23: gpio host commands gpio host command value type description set gpio property 0x8400 synchronous set a property of one or more gpio pins get gpio property 0x8401 synchronous re trieve a property of a gpio pin set gpio state 0x8402 synchronous set the state of a gpo pin or pins get gpio state 0x8403 synchronous ge t the state of a gpi pin or pins set gpi association 0x8404 synchronous associate a gpi pin state with a command sequence stored in spi nvm get gpi association 0x8405 synchronous retrieve a gpio pin association table 24: flash ma nager host command flash mgr host command value type description get lock 0x8500 asynchronous reques t the flash manager access lock lock status 0x8501 synchronous retrieve the status of the access lock request release lock 0x8502 synchronous rele ase the flash manager access lock config 0x8503 synchronous configure the fl ash manager and underlying spi nvm subsystem read 0x8504 asynchronous re ad data from the spi nvm write 0x8505 asynchronous write data to the spi nvm erase block 0x8506 asynchronous erase a block of data from the spi nvm erase device 0x8507 asynchronous erase the spi nvm device query device 0x8508 asynchronous query device-specific information status 0x8509 synchronous obtain status of current asynchronous operation config device 0x850a synchronous configure the attached spi nvm device table 25: sequencer host command sequencer host command value type description refresh 0x8606 asynchronous refresh the automatic image processing algorithm configuration refresh status 0x8607 synchronous retrieve the status of the last refresh operation table 26: patch loader host command patch loader host command value type description load patch 0x8700 asynchronous load a patch from spi nvm and automatically apply status 0x8701 synchronous get status of an active load patch or apply patch request
ap0100cs hdr: image signal processor (isp) summary of host commands ap0100cs/d rev. 6, pub. 1/16 en 56 ?semiconductor components industries, llc,2016. apply patch 0x8702 asynchronous apply a patch (already located in patch ram) reserve ram 0x8706 synchronous reserve ram to contain a patch table 27: miscellaneous host command miscellaneous host command value type description invoke command seq 0x8900 synchronous invoke a sequence of commands stored in spi nvm config command seq processor 0x8901 synchronous configures the command sequence processor wait for event 0x8902 synchronous wait for a system event to be signalled table 28: calibration stats host commands calibration stats host command value type description calib stats control 0x8b00 asynchronous start statistics gathering calib stats read 0x8b01 synchronous read the results back table 29: event monitor host command event monitor host command value type description event monitor set association 0x8c00 synchronous associate an system event with a command sequence stored in nvm event monitor get associ ation 0x8c01 synchronous retrieve an event association table 30: cci manager host commands cci manager host command value type description get lock 0x8d00 asynchronous request the cci manager access lock lock status 0x8d01 synchronous retrieve the status of the access lock request release lock 0x8d02 synchronous release the cci manager access lock config 0x8d03 synchronous configure the cci manager an d underlying cci subsystem set device 0x8d04 synchronous set the target cci device address read 0x8d05 asynchronous read one or more bytes from a 16-bit address write 0x8d06 asynchronous write one or more bytes to a 16-bit address write bitfield 0x8d07 asynchronous read-modify-write 16-bit data to a 16-bit address cci status 0x8d08 synchronous obtain status of current asynchronous operation table 31: sensor ma nager host commands sensor manager host command value type description discover sensor 0x8e00 synchronous discover sensor initialize sensor 0x8e01 synchronous initialize attached sensor table 26: patch loader host command patch loader host command value type description
ap0100cs/d rev. 6, pub. 1/16 en 57 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes usage modes how a camera based on the ap0100cs will be configured depends on what features are used. in the simplest case, an ap0100cs operating in auto-config mode with no customized settings might be sufficient. a back-up camera with dynamic input from the steering system will require a c with a system bus interface. flash sizes vary depending on the register and firmware data being transferred?somewhere between 1kb to 16mb. the two-wire bus is adequate since only high-level commands are used. in the simplest case no eeprom or flash memory or c is required, as shown in figure 39. this is truly a single chip operation. figure 39: auto-config mode the ap0100cs can be configured by a serial eeprom or flash through the spi interface. figure 40: flash mode figure 41: host mode with flash digital out auto-config mode ap0100cs + image sensor analog output serial eeprom/flash spi ap0100cs + image sensor ap0100cs + image sensor spi 8/16bit c two-wire system bus serial eeprom/flash
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 58 ?semiconductor components industries, llc,2016. in this configuration all settings are commu nicated to the ap0100cs and sensor through the microcontroller. figure 42: host mode 8/16bit c two-wire system bus ap0100cs + image sensor
ap0100cs/d rev. 6, pub. 1/16 en 59 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes caution stresses greater than those listed in table 32 may cause permanent damage to the device. this is a stress rating only, and functional ope ration of the device at these or any other con- ditions above those indicated in the operational se ctions of this specification is not implied. exposure to absolute maximum rating conditions for extended periods may affect reliabil- ity. table 32: absolute maximum ratings parameter rating unit min max digital power (1.8v) -0.3 4.95 v host i/o power (2.5v,3.3v) 2.25 5.4 v sensor i/o power (1.8v, 2.8v) 1.7 5.4 v digital dac power 1.1 2.5 v pll power 1.1 2.5 v digital core power 1.1 2.5 v otpm power (2.5v, 3.3v) 2.25 5.4 v dc input voltage -0.3 v dd io_*+0.3 v dc output voltage -0.3 v dd io_*+0.3 v storage temperature -50 150 c
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 60 ?semiconductor components industries, llc,2016. table 33: electrical characteristics and operating conditions parameter condition min typ max unit supply input to on-chip regulator (v dd _reg) 1.62 1.8 1.98 v host io voltage (v dd io_h) 2.25 2.5/3.3 3.6 v sensor io voltage (v dd io_s) 1.7 1.8/2.8 3.1 v core voltage (v dd )1.081.21.32v pll voltage (v dd _pll) 1.08 1.2 1.32 v dac digital voltage (v dd _dac) 1.08 1.2 1.32 v dac analog voltage (v dd a_dac) 3 3.3 3.6 v hispi phy votlage (v dd _phy) 2.3 2.8 3.1 v otpm power supply (v dd io_otpm) 2.25 2.5/3.3 3.6 v functional operating temperature (ambient - t a ) -30 70 c storage temperature -55 150 c
ap0100cs/d rev. 6, pub. 1/16 en 61 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes notes: 1. v ih /v il restrictions apply. 2. this is applicable only a when th e pll is bypassed. when the pll is being used then the user should ensure that v ih /v il is met. notes: 1. vil and vih have min/max limita tions specified by absolute ratings. 2. excludes pins that have internal pu resistors. table 34: ac electrical characteristics default setup conditions: f extclk = 27 mhz, v dd io_h = v dd _otpm = 2.8v, v dd _reg = v dd io_s = 1.8v, v dd a_dac=3.3v, v dd _dac=1.2v; t a = 25c unless otherwise stated symbol parameter conditions min typ max unit notes f extclk external clock frequency 6 30 mhz 1 t r external input clock rise time 10%-90% v dd io_h C 2 5 ns 2 t f external input clock fall time 90%-10% v dd io_h C 2 5 ns 2 d extclk external input clock duty cycle 40 50 60 % t jitter external input clock jitter C 500 C ps f pixclk pixel clock frequency (one-clock/pixel) 6 74.125 mhz pixel clock frequency (two-clocks/pixel) 6 84 t rpixclk pixel clock rise time (10-90%) c load =35pf C 2 5 ns t fpixclk pixel clock fall time (10-90%) c load =35pf C 2 5 ns t pd pixclk to data valid C 1 5 ns t pfh pixclk to fv high C 1 5 ns t plh pixclk to lv high C 1 5 ns t pfl pixclk to fv low C 1 5 ns t pll pixclk to lv low C 1 5 ns table 35: dc electric al characteristics symbol parameter condition min max unit notes v ih input high voltage v dd io_h or v dd io_s * 0.8 C v 1 v il input low voltage C v dd io_h or v dd io_s * 0.2 v 1 i in input leakage current v in = 0v or v in = v dd io_h or v dd io_s 10 ? a 2 v oh output high voltage v dd io_h or v dd io_s* 0.80 C v v ol output low voltage C v dd io_h or v dd io_s * 0.2 v table 36: video dac elec trical characteristics default setup conditions: f extclk = 27 mhz, v dd io_h = vdd_otpm = 2.8v, v dd _reg = v dd io_s = 1.8v, v dd a_dac=3.3v, v dd _dac=1.2v; t a = 25c unless otherwise stated parameter symbol min typ max unit comments dc accuracy differential nonlinearity dnl 1 lsb integral nonlinearity inl 3 lsb load capacitance cload 10 pf at maximum output current
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 62 ?semiconductor components industries, llc,2016. figure 43: frame_sync (int erlaced operation) diagram offset error oer 1 % fs for differental output only gain error dger 2 % fs absolute gain error ger 5 % fs table 37: frame_sync (inter laced operation) parameters parameter name conditions min typ max unit t_frame_sync t_frame_sync 3 extclk cycles t_resync t_resync ntsc 100 ms t_resync t_resync pal 120 ms table 36: video dac elec trical characteristics default setup conditions: f extclk = 27 mhz, v dd io_h = vdd_otpm = 2.8v, v dd _reg = v dd io_s = 1.8v, v dd a_dac=3.3v, v dd _dac=1.2v; t a = 25c unless otherwise stated parameter symbol min typ max unit comments ?
ap0100cs/d rev. 6, pub. 1/16 en 63 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes figure 44: frame_sync (pro gressive operation) diagram table 38: tr igger timing parameter name conditions min typ max unit frame_sync to fv_out t frmsync_fvh 8 lines+ exposure time + sensor delay C C lines frame_sync to trigger_out t trigger_prop C C 9 ns t frame_sync t framesync 3 C C extclk cycles ?
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 64 ?semiconductor components industries, llc,2016. ntsc signal parameters notes: 1. black and white levels are referenced to the blanking level. 2. ntsc convention standardized by the ire (1 ire = 7.14mv). 3. dac ref=3.74k ? , load = 37.5 ?? table 39: ntsc signal parameters default setup conditions: f extclk = 27 mhz, v dd _reg = 1.8v, v dd _io_s = 1.8v, v dd a_dac= 3.3v, v dd io_otpm=2.5v, v dd _phy = 2.5v parameter min typ max units notes line frequency 15734.25 15734.27 15734.28 hz field frequency 59.94 59.94 59.94 hz sync rise time 111 148 222 ns sync fall time 111 148 222 ns sync width 4.60 4.74 4.80 ? s sync level 394041ire 2 burst level 36 40 44 ire 2 sync to setup (with pedestal off) 9.2 9.5 10.3 ? s sync to burst start 4.71 5.3 5.71 ? s front porch 1.27 1.7 2.22 ? s black level 5 7.5 10 ire 1, 2, 3 white level 90 100 110 ire 1, 2, 3
ap0100cs/d rev. 6, pub. 1/16 en 65 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes figure 45: video timing table 40: video timing: specific ation from rec. itu-r bt.470 signal ntsc 27 mhz pal 27 mhz units a h period 63.556 64.00 ? s b hsync to burst 4.71 to 5.71 5.60 0.10 ? s c burst 2.23 to 3.11 2.25 0.23 ? s d hsync to signal 9.20 to 10.30 10.20 0.30 ? s e video signal 2.655 0.20 52 +0, -0.3 ? s f front 1.27 to 2.22 1.5 +0.3, -0.0 ? s g hsync period 4.70 0.10 4.70 0.20 ? s h sync rising/falling edge ? 0.25 0.20 0.10 ? s h f a h de b c g j k
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 66 ?semiconductor components industries, llc,2016. figure 46: equalizing pulse table 41: equalizing pulse: specification from rec. itu-r bt.470 signal ntsc 27 mhz pal 27 mhz units i h/2 period 31.778 32.00 ? s j pulse width 2.30 0.10 2.35 0.10 ? s k pulse rising/falling edge ? 0.25 0.25 0.05 ? s l signal to pulse 1.50 0.10 3.0 2.0 ? s l j i k k
ap0100cs/d rev. 6, pub. 1/16 en 67 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes figure 47: v pulse table 42: v pulse: specification from rec. itu-r bt.470 signal ntsc 27 mhz pal 27 mhz units m h/2 period 31.778 32.00 ? s n pulse width 27.10 (nominal) 27.30 0.10 ? s o v pulse interval 4.70 0.10 4.70 0.10 ? s p pulse rising/falling edge ? 0.25 0.25 0.05 ? s table 43: standby current consumption default setup conditions: f extclk = 27 mhz, v dd _reg=1.8v; v dd io_h not included in measurement v dd io_s= 1.8v, v dd a_dac=3.3v, v dd io_otpm=2.5v, v dd _phy=2.5v, t a = 70c unless otherwise stated parameter condition typ max unit total standby current when asserting the standby signal 3.2 ma 6.9 mw total standby current f extclk = 27 mhz 3.5 ma 7.6 mw n m o p p
ap0100cs hdr: image signal processor (isp) usage modes ap0100cs/d rev. 6, pub. 1/16 en 68 ?semiconductor components industries, llc,2016. notes: 1. r_dac_pos=75 ? , r_dac_neg=37.5 ? , r_dac_ref= 3.74k ? 2. . current in single ended mode. when in differential mode the current will be 37.9ma. table 44: operating current consumption default setup conditions: f extclk = 27 mhz, v dd _reg=1.8v; v dd io_h not included in measurement v dd io_s= 1.8v, v dd a_dac=3.3v, v dd io_otpm=2.5v, v dd _phy=2.5v, t a = 70c unless otherwise stated symbol conditions min typ max unit v dd _reg 1.62 1.8 1.98 v v dd io_h=2.5v 2.25 2.5 2.75 v v dd io_h=3.3v 3 3.3 3.6 v v dd io_s=1.8v 1.7 1.8 1.9 v v dd io_s=2.8v 2.5 2.8 3.1 v v dd io_otpm=2.5v 2.25 2.5 2.75 v v dd io_otpm=3.3v 3 3.3 3.6 v v dd a_dac 3 3.3 3.6 v v dd _phy 2.3 2.8 3.1 v i dd _reg ntsc hispi 12-bit 63.7 ma ntsc hispi 14-bit 63.6 ma ntsc 64.1 ma pal 59.5 ma i dd io_s ntsc hispi 12-bit 3.2 ma ntsc hispi 14-bit 3.2 ma ntsc 3.3 ma pal 3.3 ma i dd io_otpm ntsc hispi 12-bit 0.1 ma ntsc hispi 14-bit 0.1 ma ntsc 0.1 ma pal 0.1 ma i dd a_dac ntsc hispi 12-bit 1, 2 19.54 ma ntsc hispi 14-bit 1, 2 19.54 ma ntsc 1, 2 19.54 ma pal 1, 2 19.54 ma i dd _phy ntsc hispi 12-bit 0.3 ma ntsc hispi 14-bit 0.3 ma ntsc 0.0 ma pal 0.0 ma total power consumption ntsc hispi 12-bit 185.66 mw ntsc hispi 14-bit 185.56 mw ntsc 185.56 mw pal 177.46 mw
ap0100cs/d rev. 6, pub. 1/16 en 69 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) usage modes table 45: inrush current supply voltage max current (ma) av dd 1.8 240 v dd io_h 2.5/3.3 260 v dd io_s 1.8 15 v dd io_s 2.8 55 v dd a_dac 3.3 270 v dd io_otpm 2.5/3.3 180
ap0100cs hdr: image signal processor (isp) two-wire serial register interface ap0100cs/d rev. 6, pub. 1/16 en 70 ?semiconductor components industries, llc,2016. two-wire serial register interface the electrical characterist ics of the two-wire serial register interface (s clk , s data ) are shown in figure 48 and table 46. figure 48: slave two wire seri al bus timing parameters (ccis) notes: 1. all values referred to vihmin = 0.9 v dd and vilmax = 0.1v dd levels. exclk = 27 mhz. 2. a device must internally provide a ho ld time of at least 300 ns for the s data signal to bridge the undefined region of the falling edge of s clk . 3. the maximum t hd;dat has only to be met if the device does not stretch the low period (t low ) of the s clk signal. 4. cb = total capacitance of one bus line in pf. the electrical characteristics of the master two-wire serial register interface (m_s clk , m_s data ) are shown in figure 49 and table 47. table 46: slave two-wire serial bus characteristics (ccis) default setup conditions: f extclk = 27 mhz; v dd io_h = v dd _otpm = 2.8v; v dd _reg = v dd io_s = 1.8v; v dd a_dac= 3.3v; v dd _dac = 1.2v; t a = 25c unless otherwise stated parameter symbol standard-mode fast-mode unit min max min max s clk clock frequency f scl 0 100 0 400 khz hold time (repeated) start condition. after this period, the first clock pulse is generated t hd;sta 4.0 - 0.6 - ? s low period of the s clk clock t low 4.7 - 1.3 - ? s high period of the s clk clock t high 4.0 - 0.6 - ? s set-up time for a repeated start condition t su;sta 4.7 - 0.6 - ? s data hold time t hd;dat 0 2 3.45 3 00.9 3 ? s data set-up time t su;dat 250 - 100 - ns rise time of both s data and s clk signals (10-90%) t r - 1000 20 + 0.1cb 4 300 ns fall time of both s data and s clk signals (10-90%) t f - 300 20 + 0.1cb 4 300 ns set-up time for stop condition t su;sto 4.0 - 0.6 - ? s bus free time between a stop and start condition t buf 4.7 - 1.3 - ? s capacitive load for each bus line cb - 400 - 400 pf serial interface input pin capacitance c in_si - 3.3 - 3.3 pf s data max load capacitance c load_sd - 30 - 30 pf s data pull-up resistor r sd 1.5 4.7 1.5 4.7 k ? s sr t su;sto t su;sta t hd;sta t high t low t su;dat t hd;dat t f s data s clk p s t buf t r t f t r t hd;sta
ap0100cs/d rev. 6, pub. 1/16 en 71 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) two-wire serial register interface figure 49: master two wire seri al bus timing parameters (ccim) notes: 1. all values referred to vihmin = 0.9 v dd and vilmax = 0.1v dd levels. exclk = 27 mhz. 2. a device must internally provide a hold time of at least 300 ns for the m_s data signal to bridge the undefined region of the falling edge of m_s clk . 3. the maximum t hd;dat has only to be met if the device does not stretch the low period (t low ) of the m_s clk signal. 4. cb = total capacitance of one bus line in pf. table 47: master two- wire serial bus characteristics (ccim) default setup conditions: f extclk = 27 mhz; v dd io_h = v dd _otpm = 2.8v; v dd _reg = v dd io_s = 1.8v; v dd a_dac= 3.3v; v dd _dac = 1.2v; t a = 25c unless otherwise stated parameter symbol standard-mode fast-mode unit min max min max m_s clk clock frequency f scl 0 100 0 400 khz hold time (repeated) start condition. after this period, the first clock pulse is generated t hd;sta 4.0 - 0.6 - ? s low period of the m_s clk clock t low 4.7 - 1.2 - ? s high period of the m_s clk clock t high 4.0 - 0.6 - ? s set-up time for a repeated start condition t su;sta 4.7 - 0.6 - ? s data hold time t hd;dat 0 2 3.45 3 00.9 3 ? s data set-up time t su;dat 250 - 100 - ns rise time of both m_s data and m_s clk time (10-90%) t r - 1000 20 + 0.1cb 4 300 ns fall time of both m_s data and m_s clk time (10-90%) t f - 300 20 + 0.1cb 4 300 ns set-up time for stop condition t su;sto 4.0 - 0.6 - ? s bus free time between a stop and star t condition t buf 4.7 - 1.3 - ? s capacitive load for each bus line cb - 400 - 400 pf serial interface input pin capacitance c in_si - 3.3 - 3.3 pf m_s data max load capacitance c load_sd - 30 - 30 pf m_s data pull-up resistor r sd 1.5 4.7 1.5 4.7 k ? s sr t su;sto t su;sta t hd;sta t high t low t su;dat t hd;dat t f s data s clk p s t buf t r t f t r t hd;sta
ap0100cs/d rev. 6, pub. 1/16 en 72 ?semiconductor components industries, llc,2016. ap0100cs hdr: image signal processor (isp) package diagram package diagram figure 50: package diagram vfbga100 7x7 case 138ah issue o date 30 dec 201 4
on semiconductor and the on logo are registered trademarks of semiconductor components industries, llc (scillc) or its subsidia ries in the united states and/or other countries. scillc owns the rights to a number of patents, trademarks, copyrights, trade secrets, and other intellectual property. a listing of scillcs pr oduct/patent coverage may be accessed at www.onsemi.com/site/pdf/ patent-marking.pdf. scillc reserves the right to make change s without further notice to any products herein. scillc makes no warranty, representat ion or guarantee regarding the suitability of its products for any particular purp ose, nor does scillc as sume any liability arising out of the application or use of any product or circuit, and specifically disclaim s any and all liability, including without limitation special, consequential or incidental damages. typical parameters which may be provided in scillc data shee ts and/or specifications can and do vary in different applications and actual performance may vary over time . all operating parameters, in cluding typicals must be va lidated for each customer a pplication by customers technical experts. scillc does not convey any license under its patent rights nor the rights of others. scillc products are not designed, intended, or authorized for use as components in systems intended for surgical implant into the body, or other applications inte nded to support or sus tain life, or for any other application in which the failure of the scillc prod uct could create a situation where personal injury or death may occur. should buyer purch ase or use scillc prod ucts for any such uni ntended or unau thorized applic ation, buyer shall indemnify and hol d scillc and its officer s, employees, subsid iaries, affiliates, and distributors harmless against all claims, costs, damages, and ex penses, and reasonable attorney fees arising out of, directly o r indirectly, any claim of personal injury or death associated with such unintended or unauthorized use, even if such claim alleges that scillc was negligent regarding the design or manufacture of the part. scillc is an equal opportun ity/affirmative ac tion employer. this literature is subject to a ll applicable copyright laws and is not for resale in any manner. ap0100cs hdr: image signal processor (isp) package diagram ap0100cs/d rev. 6, pub. 1/16 en 73 ?semiconductor components industries, llc,2016 .

▲Up To Search▲

Price & Availability of AP0100CS2L00SUGA0-DR1

	To Download AP0100CS2L00SUGA0-DR1 Datasheet File
If you can't view the Datasheet, Please click here to try to view without PDF Reader .